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(57) ABSTRACT 

A network controller system including a plurality of network 
ports and a driver system that operates the network ports as 
a team. The team is operated to simulate a single logical 
device in one of several team modes, such as fault tolerance 
or load balancing modes, to enhance performance of com- 
munication of the computer in a network. The driver system 
periodically determines and updates the status of each of the 
network ports, where the status of each is based at least on 
whether at least one directed packet has been received and 
transferred to the driver system by a respective network port. 
If any one of the network ports has not received a directed 
packet within a predetermined time period, the driver system 
commands another network port to transmit a directed 
heartbeat packet to the network port that has not received a 
directed packet. The team may include a primary and one or 
more secondary ports. The primary port sends a directed 
packet to any secondary port that has not received a directed 
packet within the predetermined time period. One or more of 
the secondary ports may each send a directed heartbeat 
packet to the primary port if the primary port has not 
received a directed packet within the predetermined time 
period. 

20 Claims^, 17 Drawing Sheets 
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NETWORK CONTROLLER SYSTEM THAT 
USES DIRECTED HEARTBEAT PACKETS 

HELD OF THE INVENTION 

The present invention relates to computer networking 
systems, and more particularly to a method and apparatus for 
providing a nctwock controller system that xises directed 
heartbeat packets. 

DESCRIPTION OF THE RELATED ART 

Computers and other devices may be networked together 
using any one of several available architectures and any one 
of several corresponding and compatible network protocols. 
A common network architecture is Ethcrae'"*, such as the 
lOBase-T and 100Base-TX Elheme™ Standards according 
to the IEEE Standard 802.3, although another Etheme™ 
architecture operating at 1 Gigabit per second (Gbps) is also 
available. In an Etherne'"' architecture, the computers each 
include a bus system with corresponding slots for receiving 
compatible network adapter expansion cards, where one or 
more of the adapter cards may be network interface cards 
(NICs). Each NIC includes an appropriate connector for 
interfacing a compatible network cable, such as a coaxial 
cable, a twisted -wire cable, a fiber optic cable, etc. For 
example, in a star configuration, each NIC includes an RJ-45 
connector for receiving a compatible RJ-45 plug of a 
twisted-wire cable, where each network cable is coupled to 
a central device such as a repeater, hub, switch, etc. 

In a packet-switched configuration, each computer or 
device sends data packets according to a selected upper level 
protocol, such as Transmission Control Protocol/Internet 
Protocol (TCP/IP), the Internet Protocol exchange (IPX), 
NetBEUI or the like. NetBEUI is short for NetBIOS 
Enhanced User Interface, and is an enhanced version of the 
NetBIOS protocol used by network operating systems such 
as LAN Manager, LAN Server, Windows for Workgroups, 
Windows 95 and Windows NT. NetBEUI was originally 
designed by IBM for IBM*s LAN Manager server and later 
extended by Microsoft and Novell TCP/IP is used in Inter- 
net applications, or in intranet applications such as a local 
area network (LAN). In this manner, computers and other 
devices share information according to the higher level 
protocols. 

One or more computers in a network configuration typi- 
cally operates as a server for other computers and devices in 
the network. Often, the other computers and devices rely on 
the server(s) for information, storage, access to databases, 
programs, other networks, etc., and various other services. It 
is desired that the server be as reliable as possible. Eacb 
computer, including the server, is typically coupled to a 
computer using a single network controller or adapter. If the 
network controller fails, the access to the server is inter- 
rupted resulting in loss of productivity and inefficiency. It is 
further desired to provide as high a bandwidth path to the 
server as possible, especially during periods of heavy 
demand and increased network traffic. A single network 
controller results in a botdcneck of data flow. 

It is desirable to improve the network efficiency and fault 
tolerance of a network in a practical and cost effective 
manner. It is also desirable to display the status and con- 
figuration of each port in an accurate and efBdent manner. 

SUMMARY OF THE INVENTION 

A network controller system according to the present 
invention includes a phirafity of network ports and a driver 
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system that operates the network ports as a team. The team 
is operated to simulate a single logical device in one of 
several team modes, such as fault tolerance or load balanc- 
ing modes to enhance performance of communication of the 
computer in a network. The driver system periodically 
determines and updates the status of each of the network 
ports, where the status of each is based at least on whether 
at least one directed packet has been received and trans- 
ferred to the driver system by a respective network port. If 
any one of the network ports has not received a directed 
packet within a predetermined time period, the driver system 
commands another network port to transmit a directed 
heartbeat packet to the network port that has not received a 
directed packet. In this manner, the driver system need only 
cause one directed heartbeat packet to be sent to test any one 
of the network ports. Directed heartbeat packets are sub- 
stantially more efficient than broadcast heartbeat packets, 
since the number of packets transmitted on a network may 
be reduced and the amount of unnecessary processing per 
heartbeat packet is reduced or even eliminated. 

The plurality of network ports may include a primary port 
and at least one secondary port. In this embodiment, if the 
primary port has not received a directed packet within a 
predetermined lime period, the driver system commands at 
least one of the secondary ports to transmit a directed 
heartbeat packet to the primary port. Alternatively, the driver 
system may command each of the secondary ports to trans- 
mit a directed packet to the primary. Also, if a secondary port 
has not received a packet within a predetermined time 
period, the driver system commands the primary port to 
transmit a directed heartbeat packet to that secondary port. 

The directed heartbeat packets may be transmitted on a 
periodic basis, such as after each timeout of a predetermined 
liming period It is possible, however, to reduce the number 
of heartbeat packets by sending them only when necessary. 
The driver system may maintain the status of each of the 
network ports using a plurality of states. The driver system 
updates the status of each of the network port after each of 
a predetermined timing interval by changing the state based 
on whether a directed packet has been received. For 
example, the states may include an ok state indicating proper 
operation, a failed state indicating that the network port is 
not operating properly, and one or more intermediate states. 
The driver system sequentially downgrades the status of a 
network port from the ok state to eadi next intermediate 
state until a directed packet is received or until the state of 
the network port is in the failed state. If and when the 
network port receives a directed packet, its status is restored 
back to the ok state. 

A packet-switched network according to the present 
invention includes a network device that maintains commu- 
nication in the network by transferring packets in the net- 
work and a computer system including a network controller 
system as previously described. The computer system fur- 
ther includes a processor, a main memory and a bus system. 
The plurality of ports are implemented by one or more 
network controllers coupled to the bus system. The driver 
system is executed by the processor from the main memory. 
The network device comprises a repealer or a switch or any 
other device for maintaining communication of packets in 
the network. 

A method of testing a plurality of network ports of a 
computer system according to the present invention includes 
operating the network ports as a team and determining the 
status of each of the network ports based on reception of 
directed packets, including directed heartbeat packets, 
within a predetermined time period. The method further 
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inchid^ commanding another network port to transmit a FIG. 6 is a block diagram illustrating the controller system 
directed heartbeat packet to any network port that has not of FIG. 3 configured as shown in FIG. 5 and transmitting 
received a directed packet within the predetermined time heartbeat multicast packets. 



period. 



FIG. 7 is a block diagram illustrating the controller system 



The network ports may include a primary port and at least s of HG. 3 configured for load balancing and a multiple 

one secondary port. If so, the method may include com- ^^^^^^^ ^^^^ ^^^^^ 
manding at least one of the secondary ports to transmit a ^. , .„ - , 

directed heartbeat packet to the primary port if the primary RG. 8 is a block diagram lUustratmg the controUer system 
port has not received a directed packet within the predeter- ^ configured as shown in FIG. 7 performing a 

mined time period. Alternatively, the method may include jq failover m the event of failure of the primary port, 
commanding each of the secondary ports to send a directed FIG. 9A is a block diagram of the controller system of 

heartbeat packet to the primary port. The method may FIG. 3 configured in a multiple receive address mode and 

further include commanding the primary port to transmit a using directed heartbeat packets to test the primary port 
directed heartbeat packet to a secondary port if that second- 93 .3 ^ ^bck diagram of the controUer system of 

ary port h^ not received a packet within the predetermmed 3 configured in a multiple receive address mode and 

time penod. using a directed heartbeat packet to test a secondary port. 
The plurahty of states may include an ok state, a failed t-t>^ * li i j- -n 4- h 

\t ,i \ . , . . . t_ . .J. J FIG. 10 IS a block diagram iHustratmg the controller 

state and at least one mtermediate state between the ok and . , ^ ^ - j l ■ 

£ -1 J * . Tc *i_ J • 1 J J system of FIG. 3 supporting dynamic mode switchmg 

railed states. If so, the method may mclude updatme the ^ . , 1 j rr ^ j * ■ • 

. ^ J. 1 \ . * .1. .1 . • . J- . . . between any of several different modes without reqmnne 

status from the ok state to the at least one mtermediate state .1. * * ^ i_ * j i & 

1 .1 1 20 that the computer system be rebooted. 

11 a directed packet has not been received with the prede- ^ 

termined timing imerval or updating the status from the at ^ diagrams illustrating controUer 

least one intermediate state to the failed state if a directed configurations that are possible for a controUer system 

packet has not been received with the predetermined timing according to the present invention. 

interval. The method may further include updating the status FIGS. 13 and 14 are graphic representations fllustrating 
to the ok state from any other state upon reception of a ^ port status designations for any one or more ports of a 

directed packet. Also the method may include sending a computer system. 

directed heartbeat packet to any of the plurality of network FIG. 15 is a graphic representation iUustrating port con- 
ports that has a state other than the ok state. figurations including teams instaUed on a computer system. 

It is now appreciated that a network controller system 3Q 
using directed heartbeat packets according to the present DETAILED DESCRIPTION OF THE 

invention is an efficient way to test one or more ports of PREFERRED EMBODIMENT 

network controUers of a computer system in a network. The piG. 1 is a block diagram an exemplary computer system 

plurality of network ports operating as team enhances the 100 that is used to ilhistrate various aspects of a network 
communication of the computer system in the network when 35 system implemented according to the present invention. The 

operating in one of several modes, such as fault tolerance or computer system 100 is preferably an IBM-compatible, 

load balancing modes. A directed heartbeat packet is sent by personal computer (PC) system or the Uke, and includes a 

one port to any other port in the team that has not received motherboard and bus system 102 coupled to at least one 

a directed packet to test its receive status. Directed heartbeat central processing unit (CPU) 104, a memory system 106, a 

packets are either not sent to other devices in the network or video card 110 or the like, a mouse 114 and a keyboard 116. 

if sent, are dropped or otherwise ignored and not processed xhe motherboard and bus system 102 includes any kind of 

by the other devices; In this manner, directed heartbeat bus system configuration, such as any combination of a host 

packets reduce extraneous packets in the system and reduce bus, one or more peripheral component interconnect (PCI) 

or eUminate unnecessary processing of extraneous packets. buses, an industry standard architecture (ISA) bus, an 
BRIEF DESCRIPTION OF THE DRAWINGS 45 extended ISA (EISA) bus, micro channel architecture 

A u *♦ J „. J- f »i. . • L (MCA) btis, etc., along with corresponding bus driver cir- 

A better understanding of the present invention can be j u j • * ? * 1 * 1 n ^ 

■ J . *u f 11 • J : -1 J J ■ r .1. cuitry and bndge interfaces, etc., as known to those skiUed 

obtamed when the foUowmg detailed description of the . , ™ t^tt mvi r ui • * r 

preferred embodiment is considered in conjuncion with the preferably incorporates any one of 

following drawings, in which: f'^"'^, ™"°FO««f°» '""^^J^l 

7 - 1 J. r . 50 typically used 10 PCs, such as the 80486, PenUum™, Pen- 

FIG. 1 IS a block diagram of an exemplary computer n™, etc. microprocessors from Intel Corp., or other 

system used m conjuncUon with the present mvenUon. ^^^^ .^^^ microprocessors such as the K6 microprocessor 

no. 2 IS a block diagram of the computer system of FIG. by Advanced Micro Devices. Tlie external circuitry prefer- 

1 coupled to a network. ably includes an external or level two {L2) cache or the Uke 

HG. 3 is a block diagram of a controller system installed 55 (not shown). The memory system 106 may include a 

on the computer system of FIG. 1 and ingilemcnted accord- memory controller or the Uke and be implemented with one 

ing to the present invention. or more memory boards (not shown) phigged into compat- 

FIG. 4A is a block diagram iUustrating the controller ible memory slots on the motherboard, although any 

system of FIG. 3 configured for a fault tolerance mode whUe memory configuration is contemplated, 
operating in a single receive address mode. other components, devices and circuitry are normaUy 

FIG. 4B is a block diagram iUustrating the controUer inchided in Uie computer system 100 are not particularly 

system of FIG. 3 and configured as shown in FIG. 4 relevant to the present invention and are not shown. Such 

performing a faUover in the event of failure of the primary other components, devices and circuit are coupled to the 

P**^ motherboard and bus system 102, such as, for example, an 

FIG. 5 is a block diagram iUustrating the controUer system 65 integrated system peripheral (ISP), an interrupt controUer 

of FIG. 3 configured for heartbeat muUicast packets using a such as an advanced programmable interrupt controUer 

heartbeat multicast address. (APIQ or the like, bus ari5iter(s), one or more system ROMs 
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(read only memory) comprising one or more ROM modxiles, and 208 may be of any type, such as another computer 

a keyboard controller, a real time clock (RTQ and timers, system, a printer or other peripheral device, or any type of 

communication ports, non-volatile static random access network device, such as a hub, a repeater, a router, a broutcr, 

memory (NVSRAM), a direct memory access (DMA) etc. The computer system 100 and the devices 204-208 are 

system, • diagnostics ports, command/status registers, 5 communicatively coupled together through a miiltiple port 

battery-backed CMOS memory, etc. Although the present network device 202, suds as a hub or switch, where each is 

invention is ilhistrated with an IBM-conapatible type PC coupled to one or more respective ports of the network 

system, it is understood that the present invention is appli- device 202. The network 200, inchiding the network device 

cable to other types of computer systems and processors as 202, the computer system 100 and each of the devices 

known to those skiUed in the art, 204-208, may operate according to any network 

The computer system 100 includes one or more output architecture, such as Etherae™, Token Ring, etc., or com- 

devices, such as speakers 109 coupled to the motherboard binations of such architectures. In the embodiment shown, 

and buses system 102 via an appropriate sound card and a the network 200 operates according to Ethernet'™, such as 

monitor or display 112 coupled to the mother board and bus such as lOBaseT at 10 Megabits per second (Mbps), 

system 102 via an appropriate video card 110. One or more ^5 100BaseTX at 100 Mbps, or 1 Gigabits per second (1 Gbps) 

input devices may also be provided such as a mouse 114 and Ethernet™. The network 200 may be form any type of Local 

keyboard 116, each coupled to the motherboard and bus Area Network (LAN) or Wide Area Network (WAN), and 

system 102 via appropriate controllers (not shown) as may comprise an intranet and be connected to the Internet, 

known to those skilled in the art. Other input and output For example, the device 208 may comprise a router that 

devices may also be included, such as one or more disk ^ connects to an Intemct provider. 

drives including floppy and hard disk drives, one or more The computer system 100 is coupled to the network 

CD-ROMs, as well as other types of input devices including device 202 via a plurality of Unks LI, L2, L3 and lA. The 

a microphone, joystick, pointing device, etc. The input and nics N1-N4 each comprise a single port to provide a 

output devices enable interaction with a user of the computer respective link L1-L4. It is noted that the computer system 

system 100 for purposes of configuration, as further ^ loo may be coupled to the network device 202 via any 

described below. number of links from one to a maximum number, such as 

The motherboard and bus system 102 is preferably imple- sixteen (16). Also, any of the NICs may have any number of 
mented with one or more expansion sbts 120, individually ports and is not limited to one. The use of multiple links to 
labeled SI, S2, S3, S4 and so on, where each of the slots 120 a single device, such as the computer system 100, provides 
is configured to receive compatible adapter or controller 30 many benefits, suc^ as fault tolerance or load balancing. In 
cards configured for the particular slot and bus type. Typical fault tolerance mode, one of the links, such as the link LI 
devices configured as adapter cards include network inter- and the corresponding NIC Nl is active while one or more 
face cards (NIGs), disk controller s such as a SCSI (Small of the remaining NICs and links are in standby mode. If the 
Computer System Interface) disk controller, video active link fails or is disabled for any reason, the computer 
controllers, sound cards, etc. The computer system 100 may 35 system 100 switches to another NIC and corresponding link, 
include one or more of several different types of buses and such as the NIC N2 and the link L2, to continue or maintain 
slots, such as PCI, ISA, EISA, MCA, etc. In the embodiment communications. Although two links may provide sufiacient 
shown, a plurahty of NIC adapter cards 122, individually fault tolerance, three or more links provides even further 
labeled Nl, N2, N3 and N4, are shown coupled to the fault tolerance in the event two or more links become 
respective slots S1-S4. The slots 120 and the NICs 122 are 40 disabled or faiL For load balancing, the computer system 
preferably implemented according to PQ, although any 100 may distribute data among the redundant links accord- 
particular bus standard is contemplated. ing to any desired criterion to increase data throughput. 

As described more fully below, each of the NICs 122 FIG. 3 is a block diagram of a controller system 300 
enables the computer system to communicate with other installed on the computer system 100 and implemented 
devices on a corresponding network. The computer system 45 according to the present invention to enable teaming of any 
100 may be coupled to at least as many networks as there are number of NIC ports to act like a single virtual or logical 
NICs 122, or two or more of the NICs 122 may be coupled device. As shown in FIG. 3, four NIC drivers D1-D4 are 
to the same network via a common network device, such as installed on the computer system 100, each for supporting 
a hub or a switch. When multiple NICs 122 are coupled to and enabling communications with a respective port of one 
the same network, each provides a separate and redundant 50 of the NICs N1-N4. The computer system 100 is installed 
hnk to tiiat same network for purposes of fault tolerance or with an appropriate operating system (0/S) 301 that sup- 
load balancing, otiierwise referred to as load sharing. Each ports networking, such as Microsoft NT, Novell Netware, or 
of the NICs 122, or N1-N4, preferably conunxmicatc using any other suitable network operating system. The 0/S 301 
packets, such as Etheme™ packets or the like. As known to inchides, supports or is othenvise loaded with the appropri- 
those skilled in the art, a destination and source address is 55 ale software and code to support one or more communica- 
included near the beginning of each Etherne™ packet, tion protocols, such as TCP/IP 302, IPX (Internet Protocol 
where each address is at least 4S bits for a corresponding exchange) 304, NetBEUI (NE'I\vork BIOS End User 
media access control (MAQ address. A directed or unicast Interface) 306, etc. Normally, each protocol binds with one 
packet includes a specific destination address ratiier than a NIC driver to establish a communication link between a 
multicast or broadcast destination. A broadcast bit is set for 60 computer and Uie network supported by the bound NIC. In 
broadcast packets, where the destination address are all ones general, binding a NIC port associates a particular commu- 
(I's). A multicast bit in the destination address is set for nication protocol with the NIC driver and enables an 
multicast packets. exchange of their entry points. Instead, in the controUer 

Referring now to FIG. 2, a block diagram is shown of a system 300, an intermediate driver 310 is installed as a stand 

network 200 that enables tiie computer system 100 to 65 alone protocol service that operates to group two or more of 

communicate with one or more other devices, sudi as the NIC drivers D1-D4 so that the corresponding two or 

devices 204, 206 and 208 as shown. The devices 204, 206 more ports function as one logical device. 
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Id particular, each of ihe protocols 3Q2-306 bind to a 
toiniporl interface (I/F) 312, and each of the NIC drivers 
D1-D4 bind to a protocol I/F 314, of the intermediate driver 
310. In this manner, the intermediate driver 310 appears as 
a NIC driver to cacii of the protocols 302-306. Also, the 
intermediate driver 310 appears as a single protocol to each 
of the NIC drivers D1-D4 and corresponding NICs N1-N4. 
The NIC drivers D1-D4 (and the NICs N1-N4) are bound 
as a single team 320 as shown in FIG. 3. It is noted that a 
plurabty of intermediate drivers may be included on the 
computer system 100, where cadi binds two or more NIC 
drivers into a team. Thus, the computer system 100 may 
support multiple teams of any combination of ports of 
installed NICs and NIC drivers. Each team, such as the team 
320, is configured to support fault tolerance or load 
balancing, such as the Fast EtherChannel by Cisco Systems, 
Inc. By binding two or more ports of physical NIC& to the 
protocol I/F of the intermediate driver, data can be routed 
through one port or the other, with the protocols interacting 
with only one logical device. 

A configuration application 303 is also included that 
interfaces with the intermediate driver 310 to enable a user 
of the computer system 100 via one or more input devices, 
such as the mouse 114 and the keyboard 116 and one or more 
output devices, such as the display 112, to combine two or 
more NIC ports and corresponding NIC drivers into a team, 
such as the team 320, and to configure the mode of operatioo 
of the formed team. A fault tolerance team is defined by 
having one port actively transmitting and receiving and 
having one or more ports in a standby or idle state. If the 
active port becomes disabled or fails for any reason, a 
failover occurs where a standby port becomes the active 
port There are at least three fault tolerance (FT) modes from 
which to choose. In a "Manual" mode, a failover occurs 
when a "Switch Now** button 402 (FIG. 4A), displayed by 
the configuration application 303 and the display 112, is 
pressed by the user regardless of whether the active port is 
in a failed state. In a "Switch On Fail*' mode, a failover 
occurs when the active port loses link or stops receiving. In 
a "SmartSwitch" mode, a failover occurs when the active 
port loses link or stops receiving and switches back to the 
original active port when that port comes back online. A load 
balancing or load sharing team is defined by having all ports 
in the team actively transmitting and receiving. 

FIG. 4A is a block diagram illustrating the controller 
system 300 configured for fauh tolerance mode while oper- 
ating in a single receive address mode. The team 320 is 
shown including the NIC drivers D1-D4 and the NICs 
N1-N4, which are collectively referred to as ports P1-P4, 
respectively. It is tmderstood, however, as shown below, that 
one or more multiple port NICs may be included, where the 
NIC ports may be divided among teams. Upon initialization, 
or during operation, the user commands via the configura- 
tion application 303 to group all of ports P1-P4 into a fault 
tolerance, single receive address mode and in any one of the 
particular FT modes. Each of the NICs N1-N4 is pre- 
programmed with a unique, bumed-in 48-bil media access 
control (MAC) address from the factory, where the MAC 
addresses are referred to as A, B, C arK3 D, respectively. The 
intermediate driver 310 includes port program logic 404 that 
commands the NIC drivers D1-D4 to program an override 
register (R) of each of the NICs N1-N4 with the same 
receive address "A**, where the selected address is the same 
as the primary port PI. The override register R is a pro- 
grammable memory that enables storage of a locally admin- 
istered address (LAA), whidi is read by the NIC at restart (a 
one-shot read) if programmed with an override receive 
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address. Each of the NIC drivers D1-D4 includes program 
logic 406 that receives a command including the override 
receive address from the jrart program logic 404 of the 
intermediate driver 310. As shown in RG. 4A, the command 
is preferably in the form of an Operation Identifier (OID), 
NIC drivers typically include a plurality of standard OEDs 
that are usually sent fi'om upper level protocols. The stan- 
dard OIDs, however, do not include an override receive 
address OID. 

When programmed in this marmer for the single receive 
address mode, the NIC ignores packets received at its port(s) 
having a destination address equal to its pre-programmed 
address and instead retrieves packets with the override 
receive address programmed into the override register R as 
the destination address, which is destination address A for 
each of the NICs N1-N4. Of course, the NIC Nl for the 
primary port PI need not be programmed since already set 
to receive address A. For each FT mode, one of the ports, 
such as the port PI, is selected by the intermediate driver 310 
as the primary port which is initially active during operation. 
The remaining ports P2-P4 are secondary ports that initially 
are in standby mode. 

During operation, the intermediate driver 310 inserts 
address A as the source address of packets transmitted via 
the port PI by the NIC Nl, and the network device 202 sends 
packets with destination address A to the computer system 
100 via the link LI to port PI. If the network device 202 is 
a hub or repeater, it repeats all packets out every other port. 
If the network device 202 is a switch, however, it learns that 
a device with address A is coupled via the link LI. If 
operating in the FT Manual Mode, the configuration appli- 
cation 303 detects assertion of the switch now button 402 by 
the user via an input device, such as the mouse 114 or 
keyboard 116, and switches the active port to one of the 
standby ports, such as the port P2. The user may have 
pressed the switch now button 402 if port PI (or the NIC Nl) 
has stopped responding (failed) as reported by the interme- 
diate driver 310 to the configuration apphcation 303 or 
simply as a matter of choice (standby). When commanded to 
40 switch to port P2, the intermediate driver 310 sends packets 
via port P2 by the NIC N2 instead of port PI, but stiU u.ses 
the address A as the source address for the packets. If the 
network device 202 is a hub or a repeater, no other change 
is necessary. If the network device 202 is a switch, it learns 
that the device with source address A has moved from Link 
LI to L2, and begins sending packets with destination 
address A to the computer system 100 via the link L2. 

If operating in the FT Switch On Fail Mode, the inter- 
mediate driver 310 detects failure of the primary port PI and 
fails over to one of the standby ports, such as the port P2 and 
the NIC N2 as shown in FIG. 4B. The intermediate driver 
310 stays with the new primary port P2 imtil it fails, and if 
so, selects another operable standby port. If operating in the 
FT SmartSwitch Mode, after failover from the primary port, 
such as the port PI, the intermediate driver 310 switches 
back to the previously active port PI if and when the 
intermediate driver 310 detects the NIC Nl back online. In 
any of the fauh tolerance modes, the significant advantage of 
the single receive address mode is that the failover does not 
require a change of the receive address of the new primary 
port. Since all of ports P1-P4 in the team are programmed 
with the same receive address A, the failover occurs as soon 
as the intermediate driver 310 detects failure of the primary 
port, or at least as soon as the user presses the switch now 
button 402 in FT Manual Mode. After the failover as shown 
in FIG. 4B, the intermediate driver 310 inserts the address A 
as the source address of the new primary port P2, which is 
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properly handled by the network device 200 regardless of 
whether it is a switch, hub or repeater. 

When two or more NIC ports are operating as a team, the 
intermediate driver 310 continuously or periodically deter- 
mines the status of each NIC and whether each NIC. is 
functioning properly. Heartbeat packets are transmitted from 
one or more NIC ports to one or more of the other NIC ports 
as a test to determine the status of functionality of the 
receiving NIC(s). The heartbeat packet may be a broadcast 
packet. Abroadcast packet, however, by definition, is sent to 
all devices in the network. For example, as shown in FIG. 2, 
a broadcast packet sent from the computer system 100 on 
any of the links L1-L4 in the network 200 is copied and 
transmitted by the network device 202 to every other port, 
whether a repeater or a switch, so that the broadcast packet 
is transmitted on every other link L1-L4 and to each of the 
devices 204, 206 and 208, as well as to any other devices 
coupled to the network device 202. Each device that receives 
a broadcast packet, including the NICs N1-N4, must process 
the broadcast packet to determine if intended for it Each 
computer in the network'200 receiving the broadcast packet 
generates an interrupt and the packet is passed to higher 
level protocols, where the packet is ultimately dropped or 
otherwise rejected. In fact, every device must process the 
received broadcast packet even though the packet is ulti- 
mately discarded by all unintended devices. This is an 
inefficient solution since the network 200 is flooded with 
substantial (and mostly, unnecessary) network overhead 
traffic. The problem is made worse by the fact that heartbeat 
packets are usually sent on a periodic basis. 

FIG. 5 is a block diagram illustrating one embodiment in 
which the intermediate driver 310 defines a Heartbeat Mul- 
ticast Address (HMC) and where the intermediate driver 310 
causes each NIC team member to register the HMC address. 
Upon power-up, boot or initialization, the O/S 301 starts 
each of the NIC drivers D1-D4 and the intermediate driver 
310. The intermediate driver 310 delects and collects any 
and all multicast addresses (not shown) supported by each 
supported higher level protocol, such as the TCP/IP 302, 
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than the primary port to leave the primary port available for 
its primary traffic rcsponsibililies. If there arc only two ports 
in a team, then both ports, including the primary port, send 
multicast heartbeat packets to monitor each other. The 
intermediate driver 310 causes the heartbeat port P2 to send 
a heartbeat packet HI via the link L2 as needed or on a 
periodic basis. Tlie intermediate driver 310 also causes the 
heartbeat port P3 to periodically send a heartbeat packet H2 
via the link L3 as needed or on a periodic basis. The user 
may program the heartbeat period via the configuration 
application 303 to a value different from a default heartbeat 
period of approximately 3 seconds. The timer logic 506 is 
programmed accordingly, and is used by the heartbeat logic 
502 to check and update the status of the ports P1-P4, and 
to determine whether and when to send multicast heartbeat 
packets. The network device 202 repeats and transmits each 
of the heartbeat packets HI and H2, so that the ports PI, P3 
and P4 each receive the heartbeat packet HI from the 
heartbeat port P2, and the ports PI, P2 and P4 each receive 
the heartbeat packet H2 from the heartbeat port P3 as shown 
in FIG. 6. 

The intermediate driver 310 inserts source address B and 
destination address HMC for the heartbeat packet HI from 
the heartbeat port P2 and inserts source address C and 
destination address HMC for the heartbeat packet H2 from 
the heartbeat port P3. The ports PI and P4, if operating 
correctly, each receive and process both heartbeat packets 
HI and H2. Port P2 receives the heartbeat packet H2 from 
port P3 and port P3 receives and processes the heartbeat 
packet HI from port P2. It is noted that if the network device 
202 repeats the heartbeat packet HI to port P2 or H2 to port 
3, then port P2 detects its own source address B and ignores 
the HI packet and port 3 detects its own source address C 
and ignores the H2 packet. The heartbeat packets HI and H2 
received and processed by the ports P1-P4 are passed to the 
intermediate driver 310, which updates the status table 504. 
All other devices coupled to the network device 202, such as 
the devices 204, 206 and 208, may receive both heartbeat 



IPX 304 and NetBEUI 306, and appends its own multicast 40 packets HI and H2, but detect the HMC destination address 



address(es), which includes the HMC address. The ioterme 
diate driver 310 then requests that each NIC driver D1-D4 
register the list of multicast addresses, including the HMC 
address. As shown in FIG. 5, each NIC driver D1-D4 and 
the corresponding NICs N1-N4 are programmed to detect 
the single node address A and the HMC address. It is noted 
that although only the HMC address is shown, each NIC 
driver D1-D4 may be programmed with a table of multicast 
addresses. The intermediate driver 310 also includes heart- 
beat logic 502 that includes memory for storing the HMC 
address and a status table 504 that maintains the status of 
each of the ports P1-P4 (including the NIC drivers D1-D4 
and the NICs N1-N4) of the team. The intermediate driver 
310 also includes a timer or timer logic 506 that determines 
the heartbeat period for checking the status of the ports 
P1-P4. The heartbeat period is referred to as the 
HEARTBEAr_TIMER_SPEED. 

FIG. 6 is a block diagram illustrating multicast heartbeat 
packets that are sent for the team 320. Each of the NIC 
drivers D1-D4 (and associated NICs N1-N4 ) are collec- 
tively shown as ports P1-P4, where PI is the initial primary 
port The intermediate driver 310 selects two ports, such as 
ports F2 and P3, to transmit multicast heartbeat packets, 
labeled HPl and HP2, respectively. Two heartbeat ports are 
needed in order to test each other since each port receives a 
copy of the multicast packet through an internal wrappitig . 
medianism. It is desired to select two heartbeat ports other 
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and drop the packets without processing them. In this 
marmer, the multicast heartbeat packets HI and H2 are 
handled much more efficiently than broadcast heartbeat 
packets. 

The intermediate driver 310 periodically updates the 
status table 504 based on received and processed packets 
including the multicast heartbeat packets HI and H2 for 
each of the ports P1-P4. If no receives have been indicated 
by a port at the time of the update, the intennediate driver 
310 changes state of that port to the next subsequent entry 
in the list provided in the following Table 1: 

TABLE 1 



State 



Description 



60 



HEAKrBEAr_310DE_0K 
(OK) 

HEAKrBEAr_310DE_RETRY 
(RETRY) 



The port, is sending and rcceaving 
correctly 

The port did not receive a directed 
packet or a multicast Heartbeat 
packet within the last Heartbeat Ttme 
Interval. A request is made to have a 

Heartbeat seiit to this port 

HEAKrBEAr_310DE_DErECr The port made a request on the last 
(DETECT) timer and is now awaiting a receive. 

If no receive happens, the port is 
failed 



05/21/2004, EAST version: 1.4.1 



us 6,381^18 Bl 



11 



TABLE 1 -continued 
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Port State 


state 


Description 


HEARraEAr_MODE_FAIL 


Hic poit is failed. Anothei request is 


(FAIL) 


made to have a Heartbeat sent to this 


port. Only a directed packet or 




Heartbeat multicast puts this port 




back into the OK stau 



It is noted that any directed packet or heartbeat multicast 
packet resets the port back to the OK state from any other 
state, inchiding the FAIL state. Thus, if the primary port is 
receiving packets more often than the heartbeat period, then 
it remains in the OK state. In the fault tolerance modes, 
however, the standby ports are generally idle and would 
otherwise step through the RETRY, DETECT and FAIL 
states rather quickly without the heartbeat packets. After a 
failover, heartbeat packets should be sent in case the network 
device 202 is a switch to notify the switch of the change in 
sending/receiving node address. If the primary port and all 
of the secondary ports go to FAIL status, a flurry of 
heartbeats are requested to be sent from all ports to all ports. 
If any port receives a packet, it's state is updated to OK and 
if the primary port is still not receiving, a failover occurs if 
any one of the standby ports is in the OK state. 

The timer logic 506 also includes a timer routine referred 
to as CheckState, which occurs every STArE_TIMER_ 
SPEED interval. The STXrE_TIMER_SPEED interval is 
shorter than the HEARTBEAr_TIMER_SPEED. When 
CheckState occurs, a counter is incremented to note the time 
elapsed since the last Heartbeat check, and if the time is 
greater than or equal to HEARTBEAr_TIMER_SPEED, 
the heartbeat state is confirmed. The intermediate driver 310 
updates the heartbeat status only on directed or multicast 
heartbeat packets. If a heartbeat state confirmation is called 
and no receive has occurred, the status is updated to the next 
state. 

Multicast heartbeat packets provide several advantages 
over broadcast heartbeat packets and directed heartbeat 
packets. As compared to broadcast heartbeat packets, mul- 
ticast heartbeat packets are processed only by the intended 
devices. Directed heartbeat packets, as further described 
below, may not be used in the single receive address mode 
since each NIC port is programmed with the same receive 
address. Also, a single multicast heartbeat packet may be 
used to test the other ports in the same team since all are 
programmed to receive the same multicast address and the 
packet is repeated to all team members. A second multicast 
heartbeat packet is also sent to the sender of the first 
heartbeat's receive capability. 

The interaaediate driver 310 also maintains two other 
states in the status table 504 for each team member port, 
including a WIRE_CABLE_FAULT state and a is 
POWER_FAILURE state. The W1RE__CABLE_FAULT 
state indicates that a status event was sent by the NIC driver 
informing the intermediate driver 310 that a wire fault has 
occurred, such as when a link or link signal is no longer 
detected. No heartbeat packet requests are handled until an 
event has been issued by the NIC driver indicating that link 
has been restored. When a NIC driver detects a cable-fault, 
it sends a status change to NDIS (Network Driver Interface 
Specification) which in turn notifies the intermediate driver 
310 in PtStatus. The status event is then marked for action 
by the intermediate driver 310. Upon a link-slate change, the 
intermediate driver 310 sends OID_GEN _MED1A_ 
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CONNECT_STArUS to all of bound lower NIC drivers 
and updates their status within the intermediate driver 310. 
If the primary port is found to be in fault, a failover occurs 
to the next port that has a status of OK or that can verify a 
good link status. 

The POWER_FAILURE sUtc indicates that a status 
event was sent by the port informing the intermediate driver 
310 that power has been lost (i.e. Hot Plug), No Heartbeat 
requests are handled until an event has been issued by the 
port indicating that power has been restored. 

The user may configure a team for load balancing in the 
single receive address mode if the intermediate driver 310 
also sends each packet with the same source address as the 
receive address. This is particularly true for TCP/IP, since 
the IP (Internet Protocol) address of the computer system 
100 is associated with one MAC address, such as the MAC 
address A of the primary port PI. For the IPX and NetBEUI 
protocols, the load balancing mode in the single receive 
address mode may cause the remote device to respond to the 
sending NIC which is not programmed to retrieve that 
packet. Thus, the intermediate driver 310 uses the address A 
as the source address for any packets transmitted by any of 
the ports P1-P4 and the addresses B, C and D are not used. 
Also, the network device 202 co\ild not be a hub or repeater 
since the computer system 100 would receive duplicate 
packets at the ports P1-P4 from other devices. And, 
although the network device 202 could be a regular switch, 
it would not operate very efficiently since it supports a given 
address at only one port and would determine that the device 
with destination address A was constantly moving between 
the links L1-L4. Instead, the network device 202 should be 
a switch that supports the port aggregation protocol. In this 
manner, the ports associated with the links L1-L4 of the 
switch 202 are aggregated and effectively treated as a single 
port, much like the team of ports P1-P4 are treated by the 
intermediate driver 310. 

The intermediate driver 310 distributes transmission of 
packets among the team, such as the team 320, including the 
ports P1-P4 as shown in FIG. 6. Since it is desired to 
maintain packet ordering, the intermediate driver 310 dis- 
tributes remote destination addresses among the team ports 
rather than distributing individual packets, so that a group of 
packets going to a given device are sent via the same port. 
For example, if the computer system 100 is sending packets 
to devices with addresses W, X, Y and Z, the intermediate 
driver 310 may select port PI for device W, port P2 for 
device X, port P3 for device Y and port P4 for device Z. In 
this manner, all packets transmitted to device W are trans- 
mitted via port PI, all packets transmitted to device X are 
transmitted via port P2, all packets transmitted to device Y 
are transmitted via port P3 and all packets transmitted to 
device Z are transmitted via port P4, and so on. 

Several methods may be used for distributing remote 
addresses among the ports in a team. In one method, the 
ports are assigned on a round-robin basis in slot order, so 
that each new remote address is assigned to the next port and 
driver. This method is acceptable but requires memory in the 
intermediate driver 310 to store a cross-reference table 
between ports and assigned addresses. In another method, 
the Modulo function is applied using the remote address and 
the number of ports in the team. Typically, the last byte (8 
bits) of the MAC address is used. For example, if the last 
byte is 10 and the number of ports is 4 (numbered 0=P1, 
1=P2, 2=P3 and 3»P4 ), then 10 MOD 4=2, so that the port 
correspond remainder 2, or port P3, is selected. This method 
has the advantage in that each port is quickly selected and 
memory is not required to store a cross-reference table. 



05/21/2004, EAST Version: 1.4.1 



us 6,38i;218 Bl 

13 14 

HG. 7 illustrates the team 320 configured as load balanc- multicast heartbeat packets and maintains the status table 
ing mode in a multiple receive address mode. In the multiple 504. Upon failover to another port, such as the port P2 after 
receive address mode, each of the NIC drivers D1-D4 and the port PI has failed, the intermediate driver 310 selects the 
the corresponding NICs N1-N4 of the ports P1-P4 arc two other ports P3 and P4 as the ports that send heartbeats, 
initially configured to receive packets having their own s When in the multiple receive address mode, it has been 
address A, B. C and D, respectively. The intermediate driver determined that an advanced heartbeat mode using directed 
310 also inserts the respective addresses A, B, C and D as the packets is more efficient as shown in FIGS. 9A and 9B. In 
source address of packets sent via the respective ports the advanced heartbeat mode, if the intermediate driver 310 
P1-P4. All of the ports P1-P4 are active and one port, such delects that the primary port PI has entered the RETOY state 
as the port PI, is initially selected to be the primary port lo as listed in Tablcl, then the intermediate driver 310 instructs 
while the remaining ports, such as the ports P2-P4 are the each of the secondary ports P2, P3 and P4 to send a directed 
secondary ports. The primary port is the handler of broadcast heartbeat packet (DH) to the primary port PI. As shown in 
and multicast packets and carries the team node address, FIG. 9A, the primary port PI has entered the RETRY state 
such as the address A, for the team 320. Load balancing with and the ports P2, P3 and P4 are commanded by the inter- 
multiple receive address mode enables efficient operation for is mediate driver 310 to send directed heartbeat packets DHl, 
the IPX and NetBEUI protocols since these protocols are DH2 and DH3, respectively, to the primary port PI. The 
able lo send and receive on each of the ports P1-P4 using the heartbeat packet DHl from P2 has source address B and 
same send and receive addresses. In particular, the interme- destination address A, the heartbeat packet DH2 for P3 has 
diatc driver 310 inserts the source address A, B, C or D in source address C and destination address A, and the heart- 
each packet sent by the ports PI, P2, P3 or P4, respectively, 20 beat packet DH3 from P4 has source address D and desti- 
so that remote devices send response packets directed to the nation address A. In this manner, even if the network device 
specific address A, B, C or D. Thus, the send and receive 202 operates as a hub or repeater and sends all of the directed 
loads are both more balanced among the NICs in a team heartbeat packets DHl, DH2 and DH3 to all of the other 
using the multiple receive address mode. devices in the network 200, such as the devices 204, 206 and 

For TCP/IP, each packet is sent with the same source 25 208, the other devices simple drop or otherwise ignore the 

address from any of the ports PI, where the source address packets and do not try to process the DH packets since the 

is selected to be the same address as the primary port PI and destination address of the DH packets specify another 

the same address that is associated with the corresponding IP device. As shown in FIG. 9B, if any of the secondary ports, 

address. Since the source address is the same and the receive such as the port P4, enters the RETRY state, then only the 

addresses are different across the ports P1-P4, the network 30 primary port PI sends a directed heartbeat packet DH4 to the 

device 202 must be a hub or repeater. If the network device port in the RETRY state. The heartbeat packet DH4 has 

202 is not a hub or repeater, then it must be a switch that source address A and destination address D. 

supports aggregate port protocol and the ports P1-P4 are FIG. 10 is a block diagram illustrating that the controller 

configured using the single receive address mode as prcvi- system 300 also supports dynamic mode switching between 

. ously described. 35 any of the modes without requiring that the computer system 

FIG. 8 is a block diagram illustrating a failover for the be rebooted. As described above, two or more NIC ports and 

team 320 when configured as load balancing mode in a associated drivers may be configured as a team to operate in 

multiple receive address mode. As shown in FIG. 8, if the any one of several modes, including a fault tolerance mode 

intermediate driver 310 detects failure of the primary port and a load balancing or sharing mode. If conditions of the 

PI, it selects another port, such as the port P2, as the primary 40 computer system 100 or the network 200 change, it may be 

port In the multiple receive address mode as shown in FIG. desired to change the mode of one or more teams of the 

8, the intermediate driver 310 swaps receive addresses computer system 100. Such mode change might otherwise 

between the new primary port and the old active port PI, require that the computer system 100 be rebooted. Reboo- 

ihereby preserving the correct node address on the network ting the computer system 100, however, is not always a 

200 for the computer system 100. In order to swap receive 45 desirable option since it may result in loss of productivity, 

addresses, the port program logic 404 of the intermediate This is particularly true of the computer system 100 is a 

driver 310 sends OID commands with respective addresses critical server of the network 200. It is desired to optimize 

B and A to the program logic 406 of the NIC drivers Dl and the team configuration and operating mode without disrupt- 

D2, which temporarily halt operation of the respective NICs ing network stability. 

Nl and N2, re -programs each of the override registers (R) 50 As shown in FIG. 10, the configuration application 303 

with the desired new addresses (B and A, respectively), and also includes mode select code or a mode select module 

then restarts the NICs Nl and N2 in a similar manner as 1002 that enables a user to select any of the supported 

previotjsly described. In this manner, a reboot is not required operating modes of the ports of the NICs coupled to the 

and the old primary failed port PI is programmed with computer system 100, such as the NICs N1-N4, The mode 

receive address B and the new primary port P2 is pro- 55 select module 1002 then sends one or more OIDs to send 

grammed with receive address A. As before, the network determination logic 1004 of the intermediate driver 310, * 

device 202, if operating as a switch, learns that address Ahas including an OID with a mode value indicative of a desired 

moved from link LI to fink L2. operating mode. The send determination logic 1004 coop- 

FIGS. 7 and 8 illustrate that the multicast heartbeat packet erates with the port program logic 404 to re-program the 

method to check the stattis of the ports P1-P4 is used in the 60 receive addresses of the ports P1-P4, if necessary. As 

same manner. In particular, the intermediate driver 310 previously described, the port program logic 404 sends OID 

causes each of the NIC drivers D1-D4 and the correspond- commands to the NIC drivers, which temporarily halts 

ing NICs N1-N4 to register and store the Heartbeat Mtilti- operation of corresponding NICs, re-programs each of the 

cast Address HMC, and two heartbeat ports, such as the override registers (R) with the desired new address, and then 

ports P2 and P3, are selected, labeled HPl and HP2, 65 restarts the NICs without rebooting. The OID(mode) from 

respectively. Operation is similar as that shown in FIG. 6 the mode select module 1002 is used to program a memory 

where the intermediate driver 310 monitors reception of control blodc 1006 with a MODE value indicative of the 
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selected mode of operation without having to reboot the 
computer system 100. During operation, the intermediate 
driver 310 and the send determination logic 1004 include 
operating mode switch statements that maintain the func- 
tionality of the selected mode as identified by the MODE 
value in the memory control block 1006. The intermediate 
driver 310 consults the send determination logic 1004 to 
determine how to send each packet, sudi as which port to 
use and which address to use as the source address in 
accordance with the particular selected mode of operation. 
Since the ports and the memory control block 1006 are 
re-programmed without rebooting and since the mode is 
consulted or read to send each packet, the user is able to 
dynamically select any mode at any time without having to 
reboot the computer system 100. 

FIGS, U and 12 are block diagrams illustrating controller 
configurations that are possible for a controller system 
according to the present invention. In FIG. 11, a controller 
system 1100 is illustrated that includes the 0/S 301, the 
configuration application 303, the intermediate driver 310 
and the TCP/IP 302, IPX 304 and NetBEUI 306 protocols. 
The intermediate driver 310 includes the miniport l/F 312 
and the protocol l/F 314 as previously described. Three 
NICs Nl, N2 and N3 are shown, where NICs N2 and N3 are 
multiple port NICs. In particular, the NIC N2 includes two 
ports and the NIC N3 includes four ports. The user, via 
interaction with the configuration application 303, has con- 
figured all seven of the ports of the NICs N1-N3 together 
into a single team 1102 to form ports PI, P2, P3, P4, PS, P6 
and P7 (P1-P7) of the team 1102. For each port P1-P7, a 
separate driver D1-D7, respectively, is provided. Each of the 
drivers D1-D7 bind to the protocol I/F 314 of the interme- 
diate driver 310 in a similar manner as previously described. 
The team 1102 may be configured in any of the modes 
previously described, such as fault tolerance or load 
balancing, along with the appropriate receive address 
configuration, such as either of the single or multiple receive 
address modes. 

In FIG. 12, a controller system 1200 is shown in a 
different configuration in which the user has configured the 
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FIGS. 13 and 14 are graphic representations illustrating 
port status designations for any one or more ports of a 
computer system, such as the computer system 100. FIG. 13 
illustrates Base-T (TX) cabling designations and RG. 14 
ilhisirates corresponding Fiber (FX) cabling designations. 
The graphic designations arc icons illustrated in bitmap 
form, and are displayed on the display 112 by the configu- 
ration application 303 so that the user has a visual repre- 
sentation of the designation for each port It is understood, 
however, that any acceptable graphic format may be used to 
visually illustrate the appropriate designation information. 
FIGS. 13 .and 14 illtistrate port representations rather than 
NIC representations providing a more accurate depiction of 
the controller and port configurations. 

The intermediate driver of each team monitors the status 
of each port in its team and reports the status of each port to 
the configuration applicatioo. Also, the configuration appli- 
cation retrieves status information firom respective drivers of 
ports operating independently or stand-alone. The configu- 
ration application displays the status of each port in graphi- 
cal form on the display 112. The status of each port is 
preferably updated continuously or periodically, such as 
after every timeout of a predetermined time period. The time 
period is preferably short enough to provide the user with 
relatively recent and accurate port status, such as every few 
seconds. The configuration application correspondingly 
updates the graphic representations displayed to keep the 
user informed of port status. 

Normal operation is generally represented using sohd 
graphics including plug and jack graphics interfacing each 
other. A cable fault is detected when the cable, or otherwise 
the link signal at the port, is no longer detected, A cable fault 
is represented with a plug graphic removed fi-om a jack 
graphic. A different level of shading or masking is used to 
convey a non-active or standby port. Partial shading is used 
to illustrate a powered off condition, A graphic symbol icon, 
such as an "X" or the like, is used to indicate failure. A cable 
break is also used to illustrate the powered off and failure 
conditions. An unknown condition is illustrated using a 



single port of NIC Nl, the two ports of NIC N2 and two of 4o suitable symbol icon, such as a question mark or the like. 



the ports of NIC N3 into a first team 1202 with five ports 
P1-P5 using the intermediate driver 310. Drivers D1-D5 are 
used for ports P1-P5, respectively, in a similar manner as the 
controller system 1100. For the controller system 1200, 
however, the last two ports of the NIC N3 are configured 
instead as ports PI and P2 of a separate team 1206 using a 
separate intermediate driver 1204. The intermediate driver 
1204 operates in substantially the same manner as the 
intermediate driver 310, except that it is used for a different 
team. The drivers D6 and D7 of the controller system 1100 
arc instead configured as drivers Dl and D2 for the ports PI 
and P2, respectively, of the controller system 1200. The 
drivers Dl, D2 each bind to the protocol I/F (not shown) of 
the intermediate driver 1204. The intermediate driver 1204 
also binds to the TCP/IP 302, IPX 304 and NetBEUI 306 
protocols via a corresponding miniport I/F (not shown). 

FIGS. 11 and 12 illustrate that a controller system accord- 
ing to the present invention is port-centric and enables a user 
to configure ports in any desired manner regardless of 
whether the ports arc located on the same NIC. The seven 
ports P1-P7 may be configured in any combination and in up 
to three (3) different teams using three different intermediate 
drivers, where each team includes at least two ports. Also, 
any one or more of the ports may be configured indepen- 
dently in which the corresponding driver directly binds to 
any one of the upper level protocols, such as the TCP/IP 302, 
IPX 304 and NetBEUI 306 protocols. 
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A team is shown using a team symbol icon along with a 
separate cable link. Any combination of the shading, graph- 
ics and symbols may be used to illustrate corresponding 
combined conditions. In alternative embodiments, color or 
shades of gray may be used in the alternative or in addition 
to different shading, masking or symbols. For example, a 
failed condition may be conveyed using a red-colored "X^ 
on the port graphic icon, or any different color may be used 
instead of shading or masking to convey non-active, pow- 
ered or failed conditions. 

In FIG. 13, each port designation includes a solid cable 
graphic icon 1302 illustrating a corresponding port. For 
Base-T, each port designation also includes a corresponding 
plug graphic icon 1304 and jack graphic icon 1306. A 
normal operation graphic icon 1310 illustrates normal opera- 
lion including a solid cable graphic icon 1302 with the plug 
graphic icon 1304 interfacing the jack graphic icon 1306. A 
cable fault graphic icon 1312 is similar to the normal 
operation graphic icon 1310 but shows the plug graphic icon 
1304 removed from the corresponding jack graphic icon 
1306. The cable fault graphic icon 1312 is used for cases in 
which the port is installed but the cable is pulled or non- 
functional so that Unk is not detected. A non-active graphic 
icon 1314 is similar to the normal graphic icon 1310 in 
which the plug graphic icon 1304 is shown interfacing the 
jack graphic icon 1306. However, the non-active graphic 
icon 1314 includes a shaded (or masked) cable graphic icon 
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1315 indicating that the port is in standby or non-aclive respectively, where port 3-1 is a fiber optic port in active 

mode. The non- active graphic icon 1314 is used to illustrate mode and port 3-2 is a Base-T port in standby mode. The 

a standby port of a team. A non-active cable with fault label foltowing each port symbol in the team 1510 denotes 

graphic icon 1316 is similar to the non-active graphic icon the team number and port number of the team (team-port), 

1314 except inchiding a shaded cable and plug graphic icon 5 the manufacturer and type of the particular controller card, 

1317 in which the phig graphic icon is shown removed from ^« number of the particular NIC (if a multiple port 

the corresponding jack graphic icon 1306. The non-active NIC), the slot number of the particular bus and the bus 

with cable fault graphic icon 1316 is used to illustrate a number For example, port 3-1 of the team 1510 compris^^^^ 

standby port combined with a cable fault. ^ of a multiple port Compaq Gigabit Module NC6132 

A Dowercd off Branhic icon 1318 illustrates an installed lO Conipaq Computer CorporaUon (Compaq) plugged mto 
A powered on graptuc icon illustrates an installed 10 ^^^^ ^^^^ ^ ^^^^^^ ^ 3 ^ of the team 

mc m which the slot is powered ofif The ability to sepa- ^^^^ ^ ^ single-port Compaq Fast Ethernet NIC 

rately enable or disable power f any slot such as any of the ^^^3121 plugged into^loi 3 of bus 2 It is noted that the 

slots S1-S4 ot the computer system 100, enables replace- computer system has multiple buses, each given a particular 

ment or otherwise hbt-pluggmg of the slot with another ^us number to fadUtate identification and location of the 

controller, if desired. The powered off graphic icon 1318 15 controUers. In the embodiment shown, the computer system 

includes a cable break graphic icon 1320 and a partially includes at least 9 different PCI buses. 

shaded cable and plug graphic icon 1319 with the plug The other team 1520, numbered 7 and labeled "Compaq 

graphic icon interfacing the corresponding jack graphic icon Load Sharing Controller Team", includes 3 ports labeled 

1306. A powered off when cable faulted graphic icon 1322 7-1, 7-2 and 7-3, respectively. The team 1520 is configured 

is similar to the powered off graphic icon 1318 except that 20 to operate in a load sharing mode in which all three ports 

a partially shaded cable and plug graphic icon 1321 iUus- 7-1, 7-2 and 7-3 are active. A stand-alone port (8) is also 

trates a plug graphic icon removed fi-om the jack graphic included comprising a single-port Compaq Fast Ethernet 

icon 1306. NIC NC3161 by Compaq plugged into slot 2 of bus 1 and 

An unknown state graphic icon 1324 includes an appro- is in active mode. Finally, an iminstalled, stand-alone port 

priate graphic icon symbol 1326, such as a question mark (?) 25 comprising port 3 of a multiple port Compaq Gigabit 

or the Hke, to iUustrate an unknown condition of the NIC. Module NC6133 is phigged into slot 9 of bus 9. The user 

UsuaUy, the unknown slate graphic icon 1324 indicates that ""^y ^ configuration application, such as the configura- 

hard ware (a NIC) has been detected in a slot of the computer apphcation 303, to install the uninstalled port, although 

and that a driver instance has been provided The computer computer system must be rebooted to complete the 

must be rebooted, however, to recognize the new NIC and 30 instaUation. Further, the stand-alone teams may be joined to 

driver configuration. Ahardware failure graphic icon 1328 is ^^^^ ^ ^^^^ stand-alone ports may 

similar to the noraial graphic icon 1304 except including a either of the existing teams 1510 or 1520. Any 

cable break 1320 and an appropriate graphic symbol icon ^^^^ re-groupmg of the ports, however, requires rebootmg of 

1330, such as an "X'' mark or the like, to iUustrate a failed computer to implement. 

controller. A hardware failure when powered off graphic 35 ^ appreciated that a network controller system 

icon 1332 is provided that is similar to the hardware failure ^^^^S directed heartbeat packets according to the present 

graphic icon 1328 except partially shaded to convey a invention is an efficient way to test one or more ports of 

combined powered off condition. An uninstalled graphic network controllers of a computer system in a network. The 

icon 1334 indicates that hardware, such as a NIC, has been plurality of network ports operating as team enhances the 

detected but a driver instance has not been installed for the 40 communication of the computer system in the network when 

NIC. Once a driver instance is provided for the detected operating in one of several modes, such as fault tolerance or 

NIC, the uninstalled graphic icon 1334 changes to the load balancmg modes. A directed heartbeat packet is sent by 

unknown state graphic icon 1324, which further changes to ^^^^^ P^^^ i^ received 

one of the other known graphic conditions after the com- * directed packet to test its receive status. Directed heartbeat 

puter is rebooted. 45 Packets are either not sent to other devices in the network, 

FIG. 14 illustrates graphic representations of Fiber (FX) i^ ^^^^> dropped or otherwise ignored and not pro- 

cabUng port type designations for any one or more ports of devices. In this manner, directed heart- 

a computer system, such as the computer system 100. The ^^^^ packets reduce extraneous packets in the system and 

graphic icons correspond to the graphic icons of FIG. 13 ^^^^^^ eliminate unnecessary processing of extraneous 

except using a fiber plug graphic icon 1402 and correspond- 50 Packets. 

ing fiber jack graphic icon 1404. In particular, FIG. 14 shows . Although a system and method according to the present 

fiber cable graphic icon representations including a normnal invention has been described in connection with the pre- 

operation graphic icon 1410, a cable fault graphic icon 1412, ^^^^^ embodiment, it is not intended to be limited to the 

a non-active graphic icon 1414, a non-active with cable fault specific form set forth herein, but on the contrary, it is 

graphic icon 1416, a powered off graphic icon 1418, a 55 intended to cover such alternatives, modifications, and 

powered off when cable faulted graphic icon 1422, an equivalents, as can be reasonably included within the spirit 

unknown stale graphic icon 1424, a hardware graphic icon scope of the invention as defined by the appended 

1428, a hardware failure when powered off graphic icon claims. 

1432 and an iminstalled graphic icon 1454. claim: 

HG. 15 is a graphic representation of a port configuration 60 . 1- A network controller system for a computer, compris- 

1500 including teams installed on a computer system. A ^S* 

team graphic icon 1502 and an extension link graphic icon a plurality of network ports, eadi having a unique receive 

1504 are used to designate each team, such as teams 1510 address and coupled to a nctwodt; 

and 1520. The team 1510 is given a team number of 3 and a driver system that operates the plurality of network ports 

labeled "Compaq Fault Tolerant Controller Team", indicat- 65 as a team; 

ing that the team 1510 is operating in a fault tolerance mode. the driver system periodically determining and updating 

The team 1510 includes two ports, labeled 3-1 and 3-2, the status of eaci of the plurality of network ports, the 
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Status of eadi based at least on whether at least one 
directed packet has beea received and transferred to the 
driver system by a respective network port; and 
if any one of the phirality of network ports has not 
received a directed packet within a predetermined time 
period, the driver system commanding any other one of 
the phirality of network ports to transmit a directed 
heartbeat packet to the any one of the plurality of 
network ports. 

2. The network controller system of claim 1, further 
comprising: 

the plurality of network ports including a primary network 
port and at least one secondary network port; 

if the primary network port has not received a directed 
packet within a predetermined time period, the driver 
system commanding at least one of the secondary 
network ports to transmit a directed heartbeat packet to 
the primary network port; and 

if any one secondary network port has not received a 
packet within a predetermined time period, the driver 
system commanding the primary network port to trans- 
mit a directed heartbeat packet to the any one second- 
ary network port. 

3. The network controller system of claim 2, further 
comprising: 

if the primary network port has not received a directed 
packet within a predetermined time period, the driver 
system commanding each of the at least one secondary 
network ports to transmit a directed heartbeat padcet to 
the primary network port. 

4. The network controller system of claim 1, further 
comprising: 

the status of each of the plurality of network ports 

including a plurality of states; and 
the driver system updating the status of each of the 

plurality of network ports after each of a predetermined 

timing interval by changing the state based on whether 

a directed packet has been received. 

5. The network controller system of claim 4, further 
comprising: 

the plurality of states including an ok state, a failed state 
and at least one intermediate state between the ok and 
failed states; 

the driver system updating the status from the ok state to 
the at least one intermediate state if a directed packet 
has not been received with the predetermined timing 
interval and from the at least one intermediate state to 
the failed state if a directed packet has not been 
received with the predetermined timing interval; and 

the driver system updating the status to the ok state from 
any other state upon reception of a directed packet. 

6. The network controller system of claim 4, further 
comprising: 

the plurality of states including a first state; and 

the driver system causing a directed heartbeat packet to be 

sent to any of the plurality of network controllers that 

has a state other than the first state. 

7. A packet-switched network, comprising: 

a netwoik device that maintains communication in the 
network by transferring packets in the network; and 

a computer system, comprising: 
a processor; 
a main memory; 

a bus system coupled to the processor and the main 
memory; 
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at least one network controller coupled to the bus 
system to implement a plurality of network ports, 
each port having a unique receive address and each 
coupled to the network device via a corre^nding 
one of a plurality of network links; 
a driver system, executed by the processor firom the 
main memory, that operates the plurality of network 
ports as a team and that periodically determines and 
updates the status of each of the plurafity of network 
ports, wherein the status of each of the plurality of 
network ports is based at least on whether at least one 
directed packet has been received; and 
if any one of the plurality of network ports has not 
received a directed packet within a predetermined 
time period, the driver system commanding any 
other one of the plurality of network ports to transmit 
a directed heartbeat packet to the any one of the 
plurality of network ports. 

8. The packet-switched network of claim 7, further com- 
20 prising: 

the plurahty of network ports including a primary port and 

at least one secondary port; 
if the primary port has not received a directed packet 
within a predetermined time period, the driver system 
commanding at least one of the secondary port to 
transmit a directed heartbeat packet to the primary port; 
and 

if any one secondary port has not received a packet within 
a predetermined time period, the driver system com- 
manding the primary port to transmit a directed heart- 
beat packet to the any one secondary port. 

9. The packet-switched network of claim 8, further com- 
prising: 

if the primary port has not received a directed packet 
within a predetermined time period, the driver system 
commanding each of the at least one secondary port to 
transmit a directed heartbeat packet to the primary 
network controller. 

10. The packet-switched network of claim 7, further 
comprising: 

' the status of each of the plurality of network ports 
including a plurality of states; and 
the driver system updating the status of each of the 
plurality of network ports after each of a predetermined 
timing interval by changing the state based on whether 
a directed packet has been received. 

11. The packet-switched network of claim 10, further 
comprising: 

the plurality of states including an ok state, a failed state 
and at least one intermediate state between the ok and 
failed states; 

the driver system updating the status from the ok state to 
the at least one intermediate state if a directed packet 
has not been received with the predetermined timing 
interval and from the at least one intermediate state to 
the failed state if a directed packet has not been 
received with the predetermined liming interval; and 
the driver system updating the status to the ok state from 
any other state upon reception of a directed packet. 

12. The packet-switched network of claim 10, further 
comprising: 

the plurality of states including a first state; and 
the driver system causing a directed heartbeat packet to be 
sent to any of the plurality of network ports that has a 
state other than the first state. 
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13. The packet-switched network of claim 7, wherein the 
network device comprises a switch. 

14. The packet-switched network of claim 7, wlierein the 
network device comprises a repeater. 

15. A method of testing a plurality of oetwoik ports of a 
computer system, comprising: 

operating the plurality of network ports .as a team; 

determining the status of c&db of the phirality of network 
ports based on reception of directed packets including 
directed heartbeat packets within a predetermined time 
period; and 

if any one of the phirality of network ports has not 
received a directed packet within the predetermined 
time period, commanding any other one of the plurality 
of network ports to transmit a directed heartbeat packet 
to the any one of the plurality of network ports. 

16. The method of claim 15, wherein the plurality of 
network ports includes a primary port and at least one 
secondary port, the commanding further comprising: 

commanding at least one secondary port to transmit a 
directed heartbeat packet to the primary port if the 
primary port has not received a directed packet within 
the predetermined time period; and 

commanding the primary port to transmit a directed 
heartbeat packet to the any one secondary port if any 
one secondary port has not received a packet within a 
predetermined time period. 

17. The network controller system of claim 16, further 
comprising: 
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commanding each of the at least one secondary port to 
transmit a directed heartbeat padcet to the primary port 
if the primary port has not received a directed packet 
within a predelenmined lime period. 

18. The method of claim 15, wherein the status of each of 
the plurality of network ports includes a phirality of states, 
further comprising: 

updating the status of each of the phirality of network 
ports after each of a predetermined timing interval by 
changing the state based on whether a directed packet 
has been received. 

19. The network controller system of claim 18, the 
plurality of states including an ok state, a failed state and at 
least one intermediate state between the ok and failed states, 
further comprising: 

updating the status from the ok state to the at least one 
intermediate state if a directed packet has not been 
received with the predetermined timing interval; 

updating the status from the at least one intermediate state 
to the failed state if a directed packet has not been 
received with the predetermined timing interval; and 

updating the status to the ok state from any other state 
upon reception of a directed packet. 

20. The network controller system of claim 18, the 
plurality of states including a first state, further comprising: 

sending a directed heartbeat packet to any of the plurality 
of network ports that has a state other than the first 
state. 
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